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The development of local norns using the Illinois 
Test of Psycholinguistic Atilities fas part of a larger study,, the 
purpose of Which was .to. identify the perceiLta^pf Arizona school 
children haying li handicap. The first step ia this part of the 
project, which involved screening for conmunication disorders, was 
the se'lection of tests 'to identify language disorders. Step 2, tie 
developient of criteria for identifying the disorder, raised the. <f 
guestion of when such a disorder should be considered pathological 
and when it shosld be considered an identifying feature of some 
dialect of English. The wain guestion^ however^ was whether a ^est 
developed for one population is valid when adwinistered to another. 
The Auditory Association and* Gr^iBatieal Closure subtests of the ITPA 
werfe adwinistered to a randow selectio'n of subjects representing the 
Arizona puMic school population. Subgroups differences appeared 
chiefly across ethnic boundaries. Fron this it i&. concluded that a 
test is valid for a specific group only if relevant- nor us have been 
developed for that group.' The Ideal norws and pther statistics on the 
study are tabulated at tl* end of the jreport. (Any ' 
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This paper was prepared at the Annual 197^ American Speech and Hearing 
Convention in Las Vegas, Nevada. . ... 



Tlie (levclopmcni of locdX norms u^^ing the I llinois Tost of Psycholingulstic 
Ab'Uities wajj part of a ^.argkr study known as the Arizona Prevalence Study. ^ - 
The Atlzojia Prevalence Study was conducted by the Arizona State IJepartment, o£ 
Education, division of Special Education in co-op:iration with th§*Pima County 
Superiutehdent of School's office. This project was lunded 1?y Titl^ VI B t^f ^ , • - 
the Educational Haridi^capp^d Act, end Regioival Resource jPent^r ^l<>^ 
Funds. The purpose of this study was ia'identif^. tJie pe^rceatage <^tjeCii0^l ^ 'y £ 



chilcTren residing, xn Arizoa/t having Ur^handicap;. Tni^ h^xidli^'^j^ 
. of aiental retardati#*n, learning disability, co^iununicatiou' M^&rdei^ de^ixe^s^ 
blindness^ or a combination, therec'f.- The author^s Tes^On^^fbititi^^ in r^iaxd' 
to the screening for coinmunication Jdisordeis^w^^ sel^^ a test of Xmu&^^ 
and 'to determine the critVria for a language, sli^orde^,. The pjopuiation bedtig 
^ sampled con ;isted of Papago Indians, ;Hexican-Aip5^caTis^ Blacl::^, aud Anglos in * 
grades.!, 3, 5, 7, and 9. 5 . ' d ^ \ ' - - \ . C : 

^ Tlie first step in^'this s^ro^ecc was tlie Selection a tesJt 
identify language disorders. At the present time the^ -c^^ tiOt appear to>e 
one specific test designed to identify /screen for conceptual^- syntacticajL 
inorphological language probleins of children* . Capxe^atiy tp^ iz(XSX PQp^^^ test \ 
"for the diagnosis of a language disoradt is t^e.IJPA. The twelve subtests 
of the ITPA take approxiicately 60-90- mixtutes to administer. The subtests • 
were designed and are being used for generating a psycholinguistic prqfile 
and, subsequent diagnosis of a language disorder. The Auditory Association 
subtest which jieasures the child's ability to relate auditorily received 
inXorination in a meaningful way, ^nd the Grammatic Closure subtest which 
nieasui'os the child s syntactical and morphological skills appear to of^er a 
<juick, valid, and reliable ^ndex of conceptual, syntactical and morphological 
laitxu*^ftc abilities for a study such as ours. For example,. corre^:C^d for 
r^•^;tr^V^ed Intellfp.cnc e rnnc»c the intgynal, cron<>i srrfnry rof*rri>i»nt nt^ nor* 



. *• ^" *8-n7/9--l for Auditory Association is ,^92 for gniimnatic CXo.sure it is .82.^ 

Hie cQjrrclatiou of tjicse two subtests with , the. overall t^st ot the same age 

, range is .70 for Auditory Association and\66 for Graramatlc Closure, these 

correlations are tepresentive of tfiose reported aciross the age raifge tested - 

in .purstudy\ Furtherraore, the fact that the nor - :^ " \ ; 

based lipon the .population allows tlie results froih these two subtests to be 

coBTpared. Thus we selected, these two subtests to screen for language disorders 

,lir the Arizona Prevalence Study;- 

: ' * The second step Which involved the development of criteria for identifying . 

a language disorder posed a definite problem. This prohlem j^as: when should ^ 

the language of a child .who speaks a dialectal form of English be labeled as / 

defective and when is it considered , a natural consequence of his or her ^ 

linguistic environment? One position is that any. child, regardless of -linguistxc 

background, who did not possess standard American ^English had a language impair- 

ment^ We >refer not to. take that position in regard to language disorders. 

Independently^ both Joan "Baratz (1967) and William Labov (1969) have 

conducted extensive research in the area of ^American English dialects. Those 

- — authors agree that culturally different children, particularly the economically 

disadvantaged Black child, posses different though complex language patterns. 

Both authors emphasize that these differences in grammar and pronunciation are- 

the result of dialectal patterns and^ should not be described as . def ieiencie55 *or 

abnormalities. Labov adds that most current testing methods afe unreliable and - 

heavily biased against Black students. The authors of this p^por agree wilh ' 

I^bov's basic position and add that current language tests 'are .biased againsY all 

groups- who posses^ dialectal patterns of English. 

As disojssed by Veiner and lloock article (1973;,. a test is v/did only 

for a particular population, the population upon v;hich it was standard l^scd. When 
' . . ^ ' -- --- ^ - ^ , . 

a -test is administered to a population that differs from that x^gon which it v;ns^ 

r — BlauUuidX^ad Lhutu Is uuud Lu veriry llu* v^^UiUiy i*r w>ims fur t; ie new pupulalXon. 

EMC ^ : 7 - ' ^ • - 



* 

Thi«, problem pres^ontly exists with published ttasts of language whoi Ihey are 
used witli children who possess dlal1*ctal English, patterns » Instocid of 

developing a new language test for the Arizona Prevalence Stiidy.a stdadard V.^ 
' test was selected and Uocal norms developed i ^ 

The norms of the Revised ITPA wete developed on a sample of 962 children ^ . * . 
residing in Bloomington, Danville, Deca. ur, and Urbana, IllinoiiSir~and- Madison, , 

• Wisconsin, Tliese norms were based upon "Only thojje children demons tracing^ 
average intellectual functioning,- average ' . . /, 

characteristics of personals-social adjustment, sensory^-iaotot integrity, and' 

. coming from English speaking families" (Paraskevopoulos and Kirk, 1969). Only 
approximately foui^ percent of the subjects w6re Black This figure is significantly 

' lower than the. proportion of Blacks living in- the five coiranunities and the United 
States as a whole. Ko other dialectal groups were included in the sample: Today ^ - 
these^are still the only norms available for interperting' the results of the I'fPA. 
¥e raise *the question as to whether such norms are appropriate for identifying 
-language disorders in Papago Indian, Mexican-American ,^Black. and Anglo children _ 
residing in Arisdna^ . ' 

There, have been a limited number of studies reported in which the "ITPA 

^ — . " ' ' ' ' f - ^ ' ^ . * - ' 

, was used with various ethnic groups. The^a studi es' have been a^/rected towards 

reporting profiles and .strengths and weaknesses rather than atte^ipting to 

develop specific norms for an individual group. Ryck;nan 0-966) used the Experimental 

Edition of^^tte ITPA to compa-rc middle and lower* socioeconomic Black chi3dren. - 

Further profiles have been obtained for Head >Start Black and" Mexican- American 



. children using tnc revised ITPA (Kirk and Kirk, 1972)* Finally, Lcmbardl (1970J 
conducted a study with first and third grade Papago Indian children residing ' 
in Piraa County, Arizona. More signiflcnntxy than i:he other profiles genera tt^l 
from studies of other ethnic groups, the Phpago Indians performed the poprest on-' 
" ^ the Auditory Association and Grammni fc Closure gubt^<;lK> yUc author concluded 
• that- these children hfid doHcm in tlie Auditory-Vocal chaniroL He mouu no - 



aisUlnctlon between children with a specific -language doflcit. and those childrf?.n ^ 
needing liuglish aa a^^sccotyd Irmguage. • XWs study attempts to make such" a . . 

aisfcinctloa. " ' o ' _ " • . • . 

the subjects foj: this study vere 976 children xandoraly^selected according 
^ to stratificiatiou on the ioHowing variables: fethnicity, urban-rural^ sex> ^md ; 
agr (grades 1./ 3, 5, 7"^anOT* "As previously laentibned the ethiiic groiips. were y 
Papago Indians, Mexican-Aiaericans> Blacks, and^glos. Both Mexican-American 
.and JVnglo' subjaqtl? veve sampled accordijag t.o urhaa and.rura^ xosidences.* Only^ - 
rural Papago Ixidians were selected siiice a very small proportion^ lived in tticsonJ 
• ,An4 only ti^ban Blacks were, sampled since a very small numbe-*- V6re rural residents. 
(Table l)f . - - , ' - 

§"' ' . " ■ ' ■ - ^ 

- - Sinc¥ the subjects were randomly selected te» represent the Ax^^ 
school population, the sample \7as not screened foil normal intellectual, functioning. 
Unlike the Kirk and Kirk norms where the children were of normal intelligence a 
percentage of children from our sample were functioning below tlie rlrst standard 
deviation from the mean on the Revised WISC. Turthermore , ' approximately half 
of ouf .sample came, from non-English speaking or bilingual homes.- ^ 

The Auditory Association and the Graminatic Closure subtest 6£ the ITPA 
. were administered to the subjects between January, 1974,- and June, 1974, according 
to the procedures describet^ in the manual. All subjects were tested by trained 
speech and*ianguage clinicians. The majority of the subjects were te^^texi by 
two clinicians, while one additional" clinician tested 13 subjects. Most of the 
testing was conducted in the schools, v;hil^ a few subjects wer^e tested in their 

home* * . ' V . ' * . 

A brief look at several tables will indicate Lfie advantages and effects^ 
1 o'f having S<^S^^P^^^^ and/or sp^ri^l' subgroup norms available. . 



1 For ex^implc, TAblc 2^ir» a display., of the mews and stamlard deviations of 
th^ Auditory Association Raw Scores/ broken down by grade, sex\ ethnic group, 
and uxhM vs rural, VJithouf getting into detail, .it .can be seen ;-hat .oex 
differences aro,, small, urban-rural differences are small, but some large 
differences occurs among ethnic groups.. The exact. nature of these differences . 
is unimportant to our prQs en t- study. 'Wliat is' important .is that sub-group 
differences do appear.. Therefore, It is unfair to make, decisioa by comparing ^ 
a gi^r^n child to- the overaM. population, even- at a giveit- grade level* 

" What is :}also important is that the interpretation given to the scores 
wiil vary, depending .upon which gr^^'^P the individual child is compared.- Table 

\ /\, ^ * . ^ ^ . . / . .\ - ^ ' \ / ; ; ' 

3 will d^njonst rate . this for^^ditory Associatioi^*. In order to cast Table_ 

3,^thrfeej separate "^notms" were created, tn Procedure I, the XTPil not mis were 

used* Procedure II utilized geoj^raphic norms; and Proc6dur^ III was completed with 

the use' of specific'' group^ norms. Thus, in I the child was compared :with children , 

of his' age level According to ITPA norms and" the percentages of the sample 

^ ^. . ^- . , ' ^ 

considered "below the'^cut-of f !' point were listed in tlie .Table. As cati be seen^ 

the Blacks, Mexican-ikiearican and.Papago Indians have greater prop rotions of • ^ 
children i^ho would be considered lower than their comparable Anglo peers. 
Particularly note the Papagq Indians Who have up £d g6% of various cells of^ 
childrea "failing" by these criteria. (Incidentally a fail included not 
merely being dov/n 1 standard deviation on^ the subtest, according to ITPA: norms, 
but being down 1 standard deviation plus 1 standard. error • .So these represent 
conservative decision making criteria.) \ 

In Proc.edure-lI,om caiT observe, the effect of comparing th(^ child only 
with those from Arizona at,.#given grade level, and sax- For thd Papago 

iiulians thelpercenLages of "fails" is miich less-. Tims-, application of gooftraphic- 

norms tends t6 reduce "the^number of. children who would be considered Jldlsorde red" 



Tlie Application ol sub-group norms reduce i\\is iiumb^ cv^n wore^ In this: 
instance the child' is compared only within his or her own .grade, sex, ^nd 
ethEiic g'roujp.''^ain the numV*er of "failures" reduces drastically in theVapago ' 

groi.ip. . * • ' i • 

The same phonomen .occur whqn looking at .Graiiima tic Closure results. The 
details oi diffexencB amoag^ groups, or the significance af difference between 
groups is not our prime, concern • Our concern is that various tests are Gsed-' 
to 4^creen (or diagnosis') chiliir(?n for language problems, B^sed on the. interpretation 
,of i:hese scores -decisions are m^e about programing and/ar^ placement • It is 
• apparent that we' must" ask ourselves the question "to whom do I wish; to compare; ^' 
thii^ cuiid?" whenever interpretations' are »made. - - . . " * - 

- For example, if one wishes ^o .know whether a child is demonstrating 
difiicuTty Ija^^ syntactical usage in standard English, one could 

' use the ITBii Gramii|itic Closure norms, knowing that he Vould be identifying children 
^ whose English language usage was variant for; a variety of reasons ♦ If it is^ - 
imp'ortant for that child to be skilled in standard English usage,- the.n children 
so designated could be- given language .stimulation programs, English as, a Second 
language programs, or whatever was (Jeemed necessary after formal assessment • , 
If one would 'Want to know how the ichild , compares with his local peers, one 
could, tfse geographic norms to help es^'tablish needs for group instructional program 
in a Liven grade . But iJf one should wish to identify language disabled child/en, - 
. i,e. those with true language disorders, then he would wint to compare them only with 
their comparable age, sex, geographic and ethnic sub-group. * |, 
' The authors hope in 'this study only to make the point that norms must 
' ^'c appropriate and reletjant. In fact, the need for the Jcivelopment of specific - 
group' norms is so aptly stated by Parnslccvopoiilas" and Kirk. (1969) when thfey . 
wrote,."Norms must be based on the pei;j:ormancc o£ groups of individuals with 
whXch i t is sensibl e to compare the porCovm azirfi of the pe nsons to bp ovalucifcML 



Thus, in picory, normH should be cQllected f or evory sub-group vith'wjiich pi] 
individual's tesi scores might • reasonablybc compared* 41m use 'of \ 



irrelevant norms can be not only meaningless, but decoptiv^, 



7 . ^ \» 



\ 



o 

ERIC 



1 , 



V 



NUMBER OF SUfUOCTS BY GRADH AND 
SUBGROUP IN -Jim ARIZONA PRKVALCNCE S'llJDY 







ANGLO 




BLACK 


MI;XICAN-A^a:RTCAN 


PAPAGO 


GR;\DE- . 


Urhan 
B G 


Riu-al 
\\ tx 


Urban 
» n 


Ui'ban 


Rural 


Rural 


1 . 


12 


12 


12 


13 


25 


i 23 


B G 
10 M-3 


D 

10 


u 
11 


B G 
26 1 27 


^ 3 


15 


13 


13 


15 


20 


22 


12 114 


9 


,11 


.27 


26 


5 


15 


13 


15 


13 


23 


,24 


13 1 13 


12 


11 


24 


29 


7 


13 


14 


15 


14 


^ 26 


27 


12 1 13 


12 




25 


26 




12 


13 


10 


10 


25 


2-3 


11 1 9 . 


9 


9 


25 


25- 



^^^^ 



O 

o 

Or 



o 




o ,0 



SI 



Pi 



I/* 



o 



V) 

o 



o, 

CO 



o 



.0 



o 



U 



in 



CO 



to 



to 



in 



to 



z 



to 



to 



to 



ro 



00 



CM 



to 



CM 



to 



to. 



to 



00 



10 



to 



CM 



CM 



CO 



•fO 



CO 



to 



fO 



10 



CO 



CO 



,7 

CM 

«. • 
'<M 



0J 



10 



rH 
•10 

10 



to 



IT 

to 



10 



to 



' to 



(M 

to 



C7i 



to 



CM 



CO 



,CM 



to 



A ^> 



11 



* . Pifcrconl of StUilpnts Below Cut-off on KFPA Auditorj.'^ in*5oci;ition ^ 
I Gfacle unci Sub-groiip in Arizonti Provulencc Study ^ 

' 1 ** ' • PROCEDURE- 1: ^tPA NOaMS ^ ■ * ■ 
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PROCI-DURE II; AR^Zd.^A NORMS . # » ' 
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PROCEDURE III: " GROUP >.m^IS 
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Pci-cent of Students Bolow Cut-oHs on ITPA Grammatic Ciosilre 
by Grade and Subgroup %n Arizona I'l-avalcnce Sttuly 

. ; . . PROCEDURl- I: ITPA- NORMS 
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